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(54) ELEMENT AND DEVICE FOR IMAGING 
(57)Abstract: 

PROBLEM TO BE SOLVED : To expand a dynamic range without generating false 
signal by improving pixel arrangement within a complex pixel, which contains two 
kinds of high and low pixels of different sensitivities. 

SOLUTION: For the color filter of a CCD image pickup element, a complex Bayer 
pattern color filter array, in which 2x2 four-pixel blocks are in the same color and in 
.which an arrangement using a block as a unit is set a Bayer array is used. In this case, 
filters of the same color at two high and low densities are diced and arranged 
(diagonally arranged) inside each complex composed of the four-pixel blocks. For 
example, a complex pixel for R is constituted of 2x2 four-pixels, having the spectral 



sensitivity characteristic of R, two pixels from among them, which are diagonally 
arranged are high- sensitivity pixels (LR) at a low filter density, and the other pixels 
which are arranged diagonally are low-sensitivity pixels (dR) at a high filter density. 
Regarding complex pixels for G and B, likewise the same structure is used, and pixels (L, 
d) of two kinds at high and low sensitivities are diced and arranged over the whole pixel 
arrangement, if the differences in the colors of the complex pixels are not taken into 
account. 
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CLAIMS 



[Claim(s)] 

[Claim l] The image sensor which is a veneer color image sensor which accomplished 
colour coding by giving the unique relative spectral sensitivity of a predetermined 
number to said each ****** while giving the relative spectral sensitivity of the same 



color to the unit pixel block slack double pixel which consists of two or more adjoining 
pixels, and is characterized by having given the sensibility of two kinds of height to two 
or more same color pixels in said each ******, and carrying out check arrangement of 
these. 

[Claim 2] The color array of said image sensor is an image sensor according to claim 1 
which is the double Bayer array said whose double pixel is the 4 pixel block beside [ 2 ] 
vertical 2x of squares and, said whose colour coding array is a Bayer array, and is 
characterized by changing the crossover pattern of check arrangement slack diagonal 
arrangement of said height 2 sensibility in said double pixel for every ******. 
[Claim 3] Said crossover pattern is an image sensor according to claim 2 characterized 
by being constituted so that it may change for every double line which is the same and 
adjoins about the same double line. 

[Claim 4] Said crossover pattern is an image sensor according to claim 2 characterized 
by the thing which are the same and adjoins about the same double row, and which is 
constituted so that it may change for every double row. 

[Claim 5] Said double Bayer array is the image sensor of four claim 2 characterized by 
being the RGB double Bayer array said whose colour coding array is a RGB Bayer array 
thru/or given in any 1 term. 

[Claim 6] The image pick up equipment characterized by to provide the image sensor of 
five claim 1 thru/or given in any 1 term, the driving means which drive said image 
sensor and read an image pick-up signal, and the picture signal generation means 
which were constituted so that it may be the picture signal generation means which can 
generate the picture signal of a predetermined format based on said image pick-up 
signal and the extensive dynamic range information about the double pixel concerned 
may be generated based on the pixel information on the sensibility of two kinds of 
height in said double pixel. 

[Claim 7] It is image pick-up equipment according to claim 6 which possesses further a 
pixel addition means to add the pixel information on the sensibility of two kinds of 
height in said double pixel, and is characterized by constituting said picture signal 
generation means so that said extensive dynamic range information may be generated 
based on the pixel information added by said pixel addition means. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image pick-up equipment which 
picturizes a photographic subject image using image sensors, such as CCD, and it. 
[0002] 

[Description of the Prior Art] The image pick-up equipment using a veneer color image 
sensor spreads widely, and is used in every direction. On the other hand, lack of a 
dynamic range is also pointed out and various solutions are proposed. 
[0003] The technique of obtaining the image which the dynamic range expanded from 
the pixel information from which a sensibility absolute value (filter density) differs in 
the same color is well-known, and what was especially applied to the pixel within the 
same color block of a double Bayer array is indicated by JP,2000-069491,A. the 4-pixel 
block with which this consists each of 2 pixels of every direction ■■ a unit pixel 
regarding (it regarding such - a unit pixel) In the image sensor which calls a double 
pixel on these specifications and calls the line constituted by the double pixel and a 
train a double line and a double row and with which this double pixel constituted the 
RGB Bayer array The large pixel information on a dynamic range is acquired by making 
into different concentration all of the 4-pixel same color filter which constitutes a double 
pixel, or arranging the same color filter of the concentration of two height at a time in 
length or two trains wide, and preparing the pixel of different sensibility in a double 
pixel. 
[0004] 

[Problem(s) to be Solved by the Invention] However, the conventional configuration 
which was described above has fault which states the effectiveness to the following of a 
certain thing. That is, although it is the same color, since the light exposure range which 
functions intentionally differs, the pixels from which concentration differs differ as a 
pixel information sampling point after all. Therefore, when RF image information is 
inputted to the sampling frequency, the alias by aliasing (moire) is produced. 
[0005] In order are [ a theoretic difficulty ] header-easy and to carry out it, an argument 
is simplified, the case where the pixel of the sensibility of two height to which a light 
exposure range does not overlap two trains long at a time is allotted is taken up, and 
black (0 level) and the gray level (COG level) equivalent to the crossover point of a light 
exposure range consider the pinstripes located in a line in the pixel pitch p which is a 
original pixel as a photographic subject input. This is periodic 2p, i.e., the 1-dimensional 
wave of frequencies l/2p. This situation is shown in drawing 6 . 

[0006] Drawing 6 (a) shows the filter array, L shows the pixel of the low high sensitivity 



(light) of filter density, and d shows the pixel of the high low sensibility d of filter 
density (dark). The list of the pixel of high sensitivity L and the pixel of the low 
sensibility d is the same about every double pixel which consists each of 2 pixels of every 
direction. If the case where the light exposure range of the pixel of high sensitivity L 
and the pixel of the low sensibility d does not overlap as mentioned above is assumed, 
the photoelectric transfer characteristic of each pixel of the sensibility of these two 
height will become like drawing 6 (c). 

[0007] In this case, when the light exposure corresponding to photographic subject 
brightness is 0 level, an output with any significant pixel of high sensitivity L and the 
low sensibility d is not produced (it becomes below a noise level.), the following - setting 
- since it is easy - this - 0 level output " calling - in the case of COG level, a saturation 
level output is produced in a high sensitivity L side, but when the output level by the 
side of the low sensibility d turns into 0 level, it is detected that it is COG level. 
Therefore, in this case, by the sampling phase shift, the outputs of each ****** will 
differ from 0 level to COG level, and serve as an alias (moire). It becomes a black solid 
output, for example, the case where gray laps with a high sensitivity L side at the black 
and low sensibility d side as shown in drawing 6 (b) L and d, since the output of a 
double pixel is 0 level since an output with any significant pixel is not produced 
Conversely, since saturation level is produced in L pixels when the phase of black and 
gray is reversed, the output of a double pixel will be detected with COG level, and will 
turn into a gray solid output. 

[0008] In addition, when there was no overlap in a light exposure range above, it was 
simplified, but even if there is overlap, unless the dynamic range of two pixels is the 
same (it is obvious that it is not possible from the purpose of this technique if the same), 
it is clear that the same alias occurs to the above-mentioned RF input in the field which 
deviated from one range, moreover, in the case of concentration which is the same in the 
case of width 2 train, considering a disk, and is different 4 pixels, only 1 pixel per double 
pixel of same phenomena the same property pixel - will be produced from a sampling 
point decreasing further also to any of pinstripes and a disk. 

[0009] moreover, in order for the sampling moire based on colour coding to occur 
separately and to prevent this from the relation which be use the double Bayer array, it 
be a premise that the optics LPF of Xtal etc. be use, but since this trap frequency be 
design corresponding to a color sampling frequency, beam of light separation width of 
face (shift amount) be invalid near [ where every direction be 2p (trap frequencies l/4p), 
and pose the above-mentioned problem ] the input frequency. 

[00 10] This invention is that which was made in consideration of the above-mentioned 



situation and which is seen, and the place made into the purpose enables it to expand a 
dynamic range, without causing generating of an alias, and is to offer the image sensor 
which can aim at sufficient improvement in image quality, and image pick-up 
equipment. 
[0011] 

[Means for Solving the Problem] In order to solve an above-mentioned technical 
problem, while this invention gives the relative spectral sensitivity of the same color to 
the unit pixel block slack double pixel which consists of two or more adjoining pixels By 
giving the unique relative spectral sensitivity of a predetermined number to said each 
******, it is the veneer color image sensor which accomplished colour coding, and is 
characterized by having given the sensibility of two kinds of height to two or more same 
color pixels in said each ******, and carrying out check arrangement of these. 
[0012] Thus, by carrying out check arrangement of the pixel of the sensibility of two 
kinds of height into a double pixel, also about the which direction of length and width, 
the same color pixel from which sensibility differs will adjoin, and will be arranged. For 
this reason, since the pixel output of two kinds of height can be equalized and obtained 
even when pinstripes and a disk of a RF which were mentioned above are inputted, an 
alias (moire) is not produced. Moreover, if it is the square pixel of that by which the pixel 
of whenever [ agreement ] will be located in a line, and will be arranged about the 
direction of slant, since the pixel pitch between the pixels of two kinds of height seen 
from across becomes narrower than the pixel pitch between the pixels of two kinds of 
height seen from length or a longitudinal direction, the frequency of extent to which the 
stripes inputted in the direction of slant are also received can control generating of an 
alias. Therefore, it becomes possible to aim at dynamic range expansion of a double 
pixel using the pixel of the sensibility of two kinds of height, without causing generating 
of aliases, such as moire. 

[0013] Moreover, when using the double Bayer array said whose double pixel is the 4 
pixel block beside [ 2 ] vertical 2x of squares and said whose colour coding array is a 
Bayer array, it is desirable to change the crossover pattern of check arrangement slack 
diagonal arrangement of said height 2 sensibility in said double pixel for every ******. 
In this case, about the same double line, a crossover pattern is the same, it can 
constitute, or it is the same about the same double row so that it may change for every 
adjoining double line, and it can be constituted so that it may change for every adjoining 
double row. Since these configurations enable it to stop in 1 double pixel that can change 
the list of the sensibility of two kinds of height by turns for every double pixel, and the 
pixel which is whenever [ agreement ] continues even when it sees from across, 



generating of the alias by the sampling phase shift between double pixels can fully be 
controlled [ as opposed to / as well as the case of pinstripes and a disk / the stripes 
inputted in the direction of slant ]. 

[0014] Moreover, as a double Bayer array, the RGB double Bayer array said whose 
colour coding array is a RGB Bayer array can be used. 

[0015] Moreover, this invention is characterized by to provide the image sensor of five 
claim 1 thru/or given in any 1 term, the driving means which drives said image sensor 
and reads an image pick-up signal, and the picture signal generation means which are a 
picture signal generation means which can generate the picture signal of a 
predetermined format, and were constituted based on the pixel information on the 
sensibility of two kinds of height in said double pixel based on said image pick up signal 
so that the extensive dynamic range information about the double pixel concerned 
might be generated. According to this image pick-up equipment, by using the pixel 
information on the sensibility of two kinds of height, the dynamic range of the 
information on each ****** can be expanded, and a high-definition image can be 
obtained. In this case, on the occasion of picture signal generation, the addition result of 
the pixel information on the sensibility of two kinds of height in a double pixel can be 
used. 
[0016] 

[Embodiment of the Invention] Hereafter, the operation gestalt of this invention is 
explained with reference to a drawing. The configuration of the image pick-up 
equipment concerning 1 operation gestalt of this invention is shown in drawing 1 . Here, 
the case where it realizes as a digital camera will be illustrated and explained. 
[0017] A lens drive for the image pick-up lens system which 101 in drawing becomes 
from various lenses, and 102 to drive a lens system 101, An exposure controlling 
mechanism for 103 to control a diaphragm of a lens system 101, the light filter for 
low-pass one and an infrared cut in 104, A CCD driver for the CCD color image sensor 
with which 105 built in the color filter, and 106 to drive an image sensor 105, A digital 
process circuit for the PURIPUROSESU circuit where 107 contains an A/D converter 
etc., and 108 to perform chrominance -signal generation processing, matrix transform 
processing, and various kinds of other digital processings, A memory card for 109 to 
record a card interface and for 110 record a photography image and 111 show the LCD 
image display system. 

[0018] Moreover, a system controller for 112 in drawing to control each part in 
generalization (CPU), An actuation display system for the actuation switch system 
which 113 becomes from various kinds SW, and 114 to display an actuation condition, a 



mode condition, etc., A lens driver for 115 to control the lens drive 102 and 116 The 
stroboscope as a luminescence means, An exposure control driver for 117 to control the 
exposure controlling mechanism 103 and a stroboscope 116 and 118 show the 
nonvolatile memory (EEPROM) for memorizing various setting information etc. 
[0019] As CCD image sensor 105, the thing of INTARAIN structure is used with a 
progressive scan (sequential scanning) mold. In this CCD image sensor 105, the 
photo-electric-conversion field (picture element part) which consists of a photodiode is 
arranged a line and in the shape of [ of a train ] a matrix, a perpendicular transfer way 
is prepared for every picture element part for one vertical train, and the common level 
transfer way is established in each perpendicular transfer way. After being first 
transported to a perpendicular transfer way, the signal from each picture element part 
is transmitted to a level transfer way through a perpendicular transfer way, and is read 
through output amplifier (floating diffusion amplifier FDA-FloatingDiffusion Amplifier). 
[0020] Although the structure of the color filter of CCD image sensor 105 is explained in 
full detail henceforth [ drawing 2 ], a double Bayer array [ as / whose array at the time 
of making a block into a unit the 4 pixel block of 2x2 is the same color, and is a Bayer 
array ] is used. In this case, with this operation gestalt, in order to aim at expansion of a 
dynamic range (D range), without causing generating of an alias (moire), diagonal 
arrangement of the same color filter of the concentration of two height is carried out in 
checkers into each ****** which consists of a 4-pixel block. 

[0021] In the digital camera of this operation gestalt, after are performing all control in 
generalization, and a system controller 112 controls the drive of CCD image sensor 105 
by the CCD driver 106, performs exposure (charge storage) and read-out of a signal, 
incorporates it in the digital process circuit 108 through the PURIPUROSESU circuit 
107 and generates the picture signal for record of a predetermined format, it records on 
a memory card 110 through the card interface 109. 

[0022] Pixel addition drive control-section 112a and extensive D range information 
generation control- section 112b are prepared in the system controller 112. Pixel addition 
drive control- section 112a is for controlling the drive of CCD image sensor 105 using the 
CCD driver 106, and performing same color addition read-out, can add the pixel 
information on the sensibility of two kinds of height in a double pixel by this same color 
addition read out, and can read it from CCD image sensor 105. Extensive D range 
information generation control-section 112b generates the extensive dynamic range 
information about each ****** using the pixel information on the sensibility of the 
addition signal acquired by same color addition read-out, or two kinds of height which 
were read according to the individual from each ****** by non-adding read-out. 



[0023] Next, with reference to drawing 2 , the filter array of CCD image sensor 105 is 
explained. 

[0024] Drawing 2 (a) shows the 1st example of the filter array used with this operation 
gestalt. This filter array is a RGB double Bayer array which made the unit the double 
pixel which consists of the 4-pixel block of 2x2, and has composition which carried out 
check (it is vertical angle like illustration in the case of 4 pixels) arrangement of the 
height 2 sensibility into each ****** (same color unit pixel block). 

[0025] Although the double pixel of R consists of 4 pixels with the spectral sensitivity 
characteristic of R of 2x2, 2 pixels by which diagonal arrangement of [ of these ] was 
carried out are a low high sensitivity pixel (LR) of filter density, and another 2 pixels by 
which diagonal arrangement was carried out are a high low sensibility pixel (dR) of 
filter density. 2 pixels by which similarly 4 pixels with the spectral sensitivity 
characteristic of G with the same said of the double pixel of G of 2x2 were consisted of, 
and diagonal arrangement of [ of these ] was carried out are a low high sensitivity pixel 
(LG) of filter density, and another 2 pixels by which diagonal arrangement was carried 
out are a high low sensibility pixel (dG) of filter density. Furthermore, it consists of two 
low sensibility pixels (dB) the same is said of the double pixel of B, and other than two 
high sensitivity pixels (LB) by which diagonal arrangement was carried out by which 
diagonal arrangement was carried out. Since the array at the time of making a double 
pixel into a unit is a Bayer array of RGB, if the difference in the color of a double pixel is 
disregarded and considered, it serves as the format that check arrangement of the pixel 
(L, d) of the sensibility of two kinds of height was carried out covering the whole pixel 
array. 

[0026] In drawing 2 (a), the crossover pattern of 2 sensibility diagonal arrangement has 
become common by all double pixels, 2 pixels (d) of low sensibility are arranged at the 
lower left and the upper right, and 2 pixels (L) of high sensitivity are arranged at the 
upper left and the lower right. 

[0027] Thus, by carrying out check arrangement of the pixel (L, d) of the sensibility of 
two kinds of height, within each pixel, the same color pixel (L, d) from which sensibility 
differs will adjoin, and will be arranged also about the which direction of length and 
width. For this reason, since the pixel output of two kinds of height can be equalized 
and obtained for every ******, without being based on a sampling phase shift even when 
pinstripes and a disk of a RF which were explained by drawing 6 are inputted, an alias 
(moire) is not produced. Moreover, the thing by which the pixel of whenever 
[ agreement ] will be located in a line, and will be arranged about the direction of slant, 
Since pixel pitch P' between the pixels of two kinds of height seen from across becomes 



narrower than the pixel pitch P between the pixels of two kinds of height seen from 
length or a longitudinal direction as shown in drawing 2 (a) (P-P/21/2), The frequency 
of extent to which the stripes inputted in the direction of slant are also received can 
control generating of an alias. Therefore, it becomes possible to aim at dynamic range 
expansion of a double pixel using the pixel of the sensibility of two kinds of height, 
without causing generating of aliases, such as moire. 

[0028] Drawing 2 (b) - (d) shows another example of the filter array used with this 
operation gestalt, respectively. These arrays are the examples at the time of changing 
the crossover pattern of 2 sensibility diagonal arrangement by the double pixel so that 
generating of the alias by the sampling phase shift between double pixels can fully be 
controlled also to the stripes inputted in the direction of slant. 

[0029] That is, drawing 2 (b) shows the case where the crossover pattern of 2 sensibility 
diagonal arrangement is changed about the same double line in the double line unit 
which is the same and adjoins. Although the crossover pattern of 2 sensibility diagonal 
arrangement is the same as drawing 2 (a) in the odd-numbered double line (l, 3, 5, ■■) in 
this drawing 2 (b) (the lower left and the upper right are the low sensibility d) The 
upper left and the lower right are a pattern (the lower left and the upper right are high 
sensitivity L, and the upper left and the lower right are the low sensibility d) with the 
crossover pattern of 2 sensibility diagonal arrangement contrary to drawing 2 (a) in 
high sensitivity L and the even-numbered double line (2, 4, 6, It is the example to 
which drawing 2 (c) changed the crossover pattern of 2 sensibility diagonal 
arrangement in the double line unit, and contrary to drawing 2 (b), in the 
even-numbered double line, the crossover pattern of 2 sensibility diagonal arrangement 
is made the same as drawing 2 (a), and drawing 2 (a) is using the crossover pattern of 2 
sensibility diagonal arrangement as the reverse pattern in the odd-numbered double 
line here. 

[0030] Drawing 2 (d) shows the case where the crossover pattern of 2 sensibility 
diagonal arrangement is changed about the same double row in the double row unit 
which is the same and adjoins. Although the crossover pattern of 2 sensibility diagonal 
arrangement is the same as drawing 2 (a) in this drawing 2 (d) at the odd-numbered 
double row (l, 3, 5, ■-) (the lower left and the upper right are the low sensibility d) The 
upper left and the lower right are a pattern (the lower left and the upper right are high 
sensitivity L, and the upper left and the lower right are the low sensibility d) with the 
crossover pattern of 2 sensibility diagonal arrangement contrary to drawing 2 (a) in 
high sensitivity L and the even-numbered double row (2, 4, 6, --)- It is the example to 
which drawing 2 (e) changed the crossover pattern of 2 sensibility diagonal 



arrangement in double row, and contrary to drawing 2 (d), in the even-numbered double 
row, the crossover pattern of 2 sensibility diagonal arrangement is made the same as 
drawing 2 (a), and drawing 2 (a) is using the crossover pattern of 2 sensibility diagonal 
arrangement as the reverse pattern with the odd-numbered double row here. 
[0031] Next, signal processing to the image pick-up signal acquired with the image 
sensor 105 which has a filter array like drawing 2 is explained. 

[0032] Here, in order to simplify explanation, the case where the light exposure range of 
the pixel of high sensitivity L and the pixel of the low sensibility d does not overlap is 
assumed. In this case, each photoelectric transfer characteristic of the pixels L and d of 
the sensibility of two height becomes like drawing 3 . By using the signal from the pixels 
L and d of the sensibility of these two height, as a dotted line shows to drawing 3 , the 
range of the intensity level (light exposure) of the photographic subject which can be 
picturized can generate the pixel information on an extensive dynamic range about 
breadth and each ******. Generation of extensive dynamic range information is divided 
roughly, and has two kinds, the case where same color addition read-out is used, and 
when the pixel information on the sensibility of two kinds of height read according to 
the individual from each ****** by non-adding read-out is used. 

[0033] First, with reference to drawing 4 , the signal-processing actuation in the case of 
using same color addition read-out is explained. First, when pixel addition drive 
control-section 112a controls the drive of CCD image sensor 105 using the CCD driver 
106 and performs same color addition read-out, a total of 4-pixel addition read-out of a 
perpendicular and 2 pixels each of horizontals which constitute it for every ****** i s 
performed (step S101). In this addition read-out, the perpendicular transfer for two 
lines is performed at 1 level blanking period by driving a perpendicular transfer way at 
a twice [ usual ] as many rate as this. Thereby, 2 pixels long in each ****** are added by 
the level transfer on the street. The pixel information after perpendicular addition 
(averaging information) is sent to output amplifier (FDA) through a level transfer way. 
And although a reset pulse is usually supplied to FDA at a rate of one pulse per pixel, 2 
pixels after the perpendicular addition which adjoins horizontally are added and read in 
FDA by controlling a level transfer drive or the supply timing of a reset pulse so that the 
level transfer for 2 pixels is performed to one reset pulse. Thus, the 4-pixel addition 
result (averaging) of 2x2 is read from CCD image sensor 105 as an image pick-up signal 
for every ******, 

[0034] After A/D conversion of the image pick-up signal after this addition is carried out, 
it is sent to the digital process circuit 108. Although the image for record may be directly 
generated to the image pick-up signal after addition with the application of signal 



processing of conventionally well-known arbitration, such as gradation processing 
(gamma, a knee, setup) and color balance processing In this example, processing for 
gradation rationalization (step S102) is performed in the digital process circuit 108 in 
advance of the usual gamma amendment processing (step S103) to the bottom of control 
of extensive D range information generation control-section 112b. Gradation 
rationalization processing (step S102) is pretreatment performed before inputting an 
addition signal into the usual gamma amendment processing, the original input light 
exposure level (photographic subject brightness) is presumed from the level of an 
addition signal here, and gradation amendment of an addition signal is performed 
based on it. 

[0035] That is, in the field where L pixels of high sensitivity are saturated since the 
pixel information on height 2 sensibility is added, and the field which is not so, since the 
photoelectric transfer characteristics differ and it becomes a polygonal* line -like non-line 
type property as the whole, when based on the magnitude of output-signal level, the 
signal (linearity signal) which is proportional to input light exposure by performing 
division processing is computed, the time of setting a d-pixel sensibility ratio [ as 
opposed to / in an image sensor output / S and L pixels for the linearity signal after SO 
(however, saturation level = maximum is set to SMAX), and amendment ] to r (<l), 
when giving an example of processing - for example, - S=S0/(l+r) • At the time of SO <= 
(l+r) and SMAX/2 What is necessary is just to consider as =(S0-SMAX/2)/r-, however 
the time of SO >= (l+r) and SMAX/2. 

[0036] In addition, although it is usually desirable to make it overlap as for a part of 
light exposure range of the pixel of two height in which sensibility differs, by performing 
above-mentioned gradation rationalization processing (step S102), even when a light 
exposure range is made to overlap, the linearity signal proportional to input light 
exposure is searched for correctly, and it becomes possible to apply it to gamma 
amendment table of gamma amendment processing (step S103). 

[0037] Next, with reference to drawing 5 , the signal-processing actuation in the case of 
using non-adding read-out is explained. First, the usual non-adding read-out for pixel 
addition drive control-section 112a to control the drive of CCD image sensor 105 using 
the CCD driver 106, and read each of each pixel according to an individual is performed 
(step Sill). After A/D conversion of the image pick-up signal read from CCD image 
sensor 105 is carried out, it is sent to the digital process circuit 108, and it is performed 
under control of data processing for acquiring extensive D range information for every 
double pixel there of extensive D range information generation control-section 112b. 
[0038] That is, processing which carries out digital addition of the signals from 2 pixels 



of whenever [ agreement / by which diagonal arrangement was carried out ] is 
performed for every ****** (step S112), and, thereby, the addition signal of low 
sensibility pixel d and the addition signal of high sensitivity pixel L are acquired. 
Subsequently, processing which compounds the addition signal of low sensibility pixel d 
and the addition signal of high sensitivity pixel L for every double pixel is performed 
(step S113). In this synthetic processing, processing in which it complements using the 
low sensibility output side which is the addition signal of low sensibility pixel d about 
the signal of the high brightness field of a more than near [ that ] the saturation level is 
performed, mainly using the high sensitivity output side which is the addition signal of 
high sensitivity pixel L, for example. Moreover, in this synthetic processing, gain 
amendment processing is performed to a high sensitivity output and a low sensibility 
output if needed, respectively in order to acquire a linearity signal like step S102 
mentioned above. That is, in consideration of the sensibility ratio r of L and d, gain 
(relatively 1/r time) higher than a high sensitivity output is given to a low sensibility 
output. And the usual gamma amendment processing (step SI 14) is performed to the 
signal after composition, and a record image is generated through each signal 
processing further a knee, a setup, color balance processing, etc. 

[0039] In addition, in addition to this, following various operation gestalten can be 
considered. 

[0040] The color array of an image sensor is good in the double color array of not only 
double BEIYAbut arbitration. Moreover, the number of configuration pixels of a double 
pixel can use the number of arbitration, as long as the pixel consistency of the image not 
only 4 pixels but the color array and for the purpose of generation allows. 
[0041] Moreover, on the occasion of addition of the pixel information on the sensibility of 
two kinds of height, only 2-pixel vertical addition is performed within a component, for 
example, and a digital operation may be made to perform level addition out of a 
component. 

[0042] Moreover, signal processing for the filter array of this invention and extensive D 
range information generation can be applied not only to a digital still camera but to a 
digital movie. 

[0043] moreover, this invention is not limited to the above-mentioned operation gestalt, 
and in the range which does not deviate from the summary, many things are boiled and 
it can be deformed at an execution phase Furthermore, invention of various phases is 
included in the above-mentioned operation gestalt, and various invention may be 
extracted by the proper combination in two or more requirements for a configuration 
indicated. For example, even if some requirements for a configuration are deleted from 



all the requirements for a configuration shown in an operation gestalt, the technical 
problem stated in the column of Object of the Invention is solvable, and when the 
effectiveness stated in the column of an effect of the invention is acquired, the 
configuration from which this requirement for a configuration was deleted may be 
extracted as invention. 
[0044] 

[Effect of the Invention] As explained above, according to this invention, a dynamic 
range can be expanded without causing generating of an alias, and it becomes possible 
to aim at sufficient improvement in image quality. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing l] The block diagram showing the configuration of the image pick-up 
equipment concerning 1 operation gestalt of this invention. 

[Drawing 2] Drawing showing the filter structure of the solid state image sensor used 
with this operation gestalt. 

[Drawing 3] Drawing showing an example of the brightness range property of the high 
concentration filter used with this operation gestalt, and a low concentration filter. 
[Drawing 4] Drawing for explaining the example of signal processing for the extensive D 
range information generation applied to this operation gestalt. 

[Drawing 5] Drawing for explaining other examples of signal processing for the 
extensive D range information generation applied to this operation gestalt. 
[Drawing 6] Drawing for explaining the conventional filter arrangement and its trouble. 
[Description of Notations] 

101 - Lens system 

102 Lens drive 

103 - Exposure controlling mechanism 

104 - Filter 

105 - CCD color image sensor 

106 - CCD driver 

107 PURIPUROSESU section 

108 " Digital process section 

109 " Card interface 

110 Memory card 



111 - LCD image display system 

112 - System controller (CPU) 

112a - Pixel addition drive control section 

112b " Extensive D range information generation control section 
118 - Nonvolatile memory (EEPROM) 

LR, LG, LB - Low concentration filter (high sensitivity pixel) 
dR, dG, dB - High concentration filter (low sensibility pixel) 
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